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ABSTRACT 

Science education specialists from Asian and Pacific 
countries convened to explore issues related to the evaluation of 
pupil science learning. This document contains a synthesis of the 
discussions and findings of the meeting. Summaries of the study 
group's deliberations are provided in four sections. Chapter 1 
describes the participating countries' experiences concerning the 
nature of and problems in pupil evaluation. Common themes and issues 
are identified and diseased concerning instruction, the educational 
environment, and student attitudes. An analysis of current objectives 
and emphases of science education occurs in chapter 2. This chapter 
contains ideas on the purposes, prerequisites, influences, and 
constraints connected with pupil evaluation. Chapter 3 offers some 
possible solutions to the identified problems. Recommendations are 
itemized for societal, teacher, instrumentation, pupil, time, local, 
curriculum, facility, and language factors. Specific strategies and 
methodologies for evaluating pupil activities are presented in 
chapter 4. Descriptive tables provide examples of evaluation 
possibilities. The participants' names and addresses are included in 
an appendix. (ML) 



****************^ 

* Reproductions supplied by EDRS are the best that can be made * 

* rrom the original document. * 
*****************^ 



9 

ERLC 



US. DC PAHTMCMT OF EDUCATION 

NATIONAL INSTITUTE OF EDUCATION 
EDUCATIONAL RESOURCES INFORMATION 
Jf CENTER (ERIC) 

V This document has been reproduced as 

received from the person or organization 

originating it. 
□ Minor changes have been made to improve 

reproduction quality. 

• Points of view or options stated in th« docu- 
ment do not necessanly represent off ical NIE 
position or policy 




PUPIL EVALUATION 
IN SCIENCE 



"PERMISSION TO REPRODUCE THIS 
MATERIAL IN MICROFICHE ONLY 
HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) " 



UNESCO REGIONAL OFFICE 
FOR EDUCATION IN ASIA AND THE PACIFIC 
Bangkok, 1985 



[APEID] Study Group Meeting, Penang, Malaysia, 9-18 
January 1985. 
Pupil evaluation in science; report. Bangkok, Unesco, 
1985. 

30 p. (Asia and the Pacific Program c of Educational 
Innovation for Development) 

1. SCIENCE EDUCATION - EVALUATION — ASIA/PACIFIC. 
2. SCIENCE EDUCATION - ACADEMIC ACHIEVEMENT - ASIA/ 
PACIFIC. I. Unesco. Regional Office for Education in Asia and the 
Pacific, Bangkok. II. Title. III. Series. 

507 

507.2 O 



3 



APEJD 



Asia and the Pacific Programme of Educational Innovation for Development 



PUPIL EVALUATION 
IN SCIENCE 

Report of a Study Group Meeting 
Penang, Malaysia 

9 - 18 January 1985 




UNESCO REGIONAL OFFICE 
FOR EDUCATION IN ASIA AND THE PACIFIC 
Bangkok, 1985 



ERIC 



4 



© Uncsco 1985 



Published by the 
Unesco Regional Office for Education in Asia and the Pacific 
P.O. Box 1425, General Post Office 
Bangkok 10500, Thailand 



Printed in Thailand 



The designations employed and the presentation of material throughout 
the publication do not imply the expression of any opinion whatsoever on 
the part of Unesco concerning the legal status of any country, territory, city 
or area or of its authorities, or concerning its frontiers cr boundaries* 



9 

ERLC 

UHB&a /M/233-1 500 



5 



This is a report of a Study Group Meeting which brought 
together 16 science education specialists from Australia, Fiji, India, 
Indonesia, Japan, Malaysia, Nepal, New Zealand, Pakistan, Philip- 
pines, Republic of Korea, Sri Lanka, Thailand and the SEAMEO 
Regional Centre for Education in Science and Mathematics 
(RECSAM), to exchange information and experiences related to 
the evaluation of pupil science learning; to identify the common 
and special problems and issues in this field; work out some poss- 
ible solutions to these problems and issues; and propose strategies 
and methodologies for developing performance evaluation in 
science. 

The Study Group Meeting was convened at the invitation of 
Unesco Regional Office for Education in Asia and the Pacific 
(ROEAP) and was jointly organized by its Asian Centre of Educa- 
tional Innovation for Development (ACEID) and RECSAM and 
was held at RECSAM, GIdgor, Penang, Malaysia, from 9-18 
January 1985. 

The Group carried out its deliberations under the Chairman- 
ship of Mr. Brandon W. Scholium (New Zealand) with Dr. N.M. 
Hcrrelia (Philippines) helping as Rapporteur. 
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Chapter 1 

CURRENT STATUS OF EVALUATION IN SCIENCE 



Introduction 

Two of the stated objectives of the Study Group Meeting were: 
to exchange information and experiences related to the evaluation 
of pupils 1 science learning, and to identify common and special 
problems and issues. Towards this end, the participan s described 
their countries 1 experiences concerning the nature of and problems 
in pupil evaluation. The purpose of this chapter is to provide a 
synthesis of these reports and to highlight common issues and 
problems. 

It was evident from the presentations that the education 
systems, science curricula and pupil evaluation procedures very 
widely from country to country on a number of dimensions. For 
example, with respect to curriculum decision making, a few countries 
reported that for all except the upper secondary level the teachers 
in each school had the responsibilities for designing and imple- 
menting their own curricula. On the other hand, a majority of the 
countries have a very centralized curriculum in which there are 
few opportunities for curriculum decision-making by teachers. In 
terms of school resources and facilities there were wide disparities 
between countries. However, it is very evident that, despite these 
differences, the issues and problems with respect to pupil evalu- 
ation are remarkably similar, 

A number of themes were identified which provide a focus for 
the discussion of the common issues and problems. Each of these 
is discussed below. 

Linking Evaluation to Instruction 

A decade or two ago, science education was primarily concerned 
with the transfer of scientific knowledge from teacher to pupil. 
The teaching strategies, mainly teacher centred, were designed to 
facilitate this process. Likewise, the evaluation procedures were 
designed to evaluate the extent to which this transfer of scientific 
knowledge of facts, rather than processes, had taken place. Pencil 
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Pupil evaluation in science 



and paper examinations, mainly emphasizing recall of information, 
were successful for this purpose. In recent years however science 
curricula have placed more emphasis on developing a broader range 
of education objectives. Terms such as "process skills 11 , "activity - 
oriented", "laboratory skills", "student interests and attitudes" 
commonly pervade the writings on science curricula. 

These development in science curricula have not, it would 
appear, been matched by changes or developments in pupil evaluation 
procedures. There is often a disparity between the stated object- 
ives of the science curriculum, which are often being imprecisely 
expressed, and the objectives that are able to be assessed by the 
pupil evaluation procedures employed by teachers and education sys- 
tems. The disparity has created some confusion in the minds of 
teachers and students, both with respect to the nature of the science 
curriculum and evaluation of pupils learning. For example, if the 
science curriculum emphasizes scientific processes but the pupil 
evaluation procedures emphasize recall of scientific knowledge, it 
is likely that the fprmer gives way to the latter. 

An analysis of the science curriculum in a given school often 
shows that there is not one but at least three versions of the cur- 
riculum. Firstly there is the intended curriculum as proposed by 
the curriculum developers. The intended curriculum has a statement 
of objectives and stated or implied teaching strategies designed to 
achieve the objectives. Influenced by a number of factors, not 
least of which are the pupil evaluation procedures, teachers re- 
interpret this curriculum and implement it in a different manner 
than what was intended. This gives rise to the translated curriculum. 
Pupils are also influenced in how they react to the teaching and 
learning experiences presented by the teacher and science curriculum 
by a number of factors such as prior experiences and teacher expect- 
ations and the achieved curriculum is thus different from the in- 
tended or translated curriculum. 

Many participants reported that the pupil evaluation proce- 
dures used were a major factor in producing this gap between in- 
tended and achieved curriculum and between instruction and evalu- 
ation. This is especially the case where external examinations are 
used. It was pointed out that for the most part external examina- 
tions evaluate pupil learning on a narrow range of objectives only, 
that is recall and comprehension of scientific information. Rarely 
are objectives relating to process skills, laboratory skills, and 
higher level cognitive skills evaluated. 

At the level of formative evaluation, the evaluation procedures 
available to and used by teachers do not serve and support the devel- 
opment of a broad range of educational objectives. In most cases 
the school level formative evaluation procedures imitate those of 
summative evaluation. For a variety of reasons, teachers do not 

2 
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Current status 

effectively use evaluation procedures for diagnosing student learn- 
ing difficulties or for determining the level of concept development 
of the students to provide feedback for improving the teaching/ 
learning process* 

The Educational Environment 

In addition to the positive changes in science curriculum, 
there have also been changes in the educational environment in re- 
cent years. These changes include: 

- The perception by government more than ever that their 
country's future prosperity is heavily determined by their 
development in science and technology and therefore on the 
quality of science education at all levels. 

- The increasing proportion of students undertaking primary 
and secondary studies in science, 

- The pressures to provide adequate education for "disadvan- 
taged 11 sectors of the community, 

- The pressures to provide special programmes for gifted 
students and for under-achieving students, 

- High parental expectations of students, especially with 
respect to science, 

- Large class sizes in many schools and inadequate or non- 
existent facilities including laboratories and science 
equipment , 

These features of the education environment have a number of 
implications for pupil evaluation in science and have also produced 
some problems. Included in these are: 

- The need to cater for all students and to allow students 
of all ability levels to undertake science studies. 

- The need to develop curricula and pupil evaluation proce- 
dures in a variety of languages, especially with respect 
to providing equivalent versions of the same external 
examination. 

- The problems associated with the language of instruction 
being other than the pupils first language. 

- The need for science curricula to be seen to be fair to all 
language, ethnic groups and for males and females. 

Teachers have improved in their ability to teach science and 
to evaluate outcomes of instruction but in many ways these pressures 
on teachers have reduced their ability to provide effective evalu- 
ation and instruction of as high a quality as they would like. 
They have tended to regress to the teacher-centred, knowledge-based 
curricula of the past. 3 
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The Purposes of Evaluation 

A number of participants expressed the view that pupil evalu- 
ation procedures were being almost exclusively used for the purposes 
of distinguishing between, ranking, passing and failing, and select- 
ing students. This is due, in no small way, to the Importance 
attached to external summative examination scores by people that 
have significant influences on pupils 1 futures. Examination scores 
are used by schools for selecting students for promotion to higher 
grades, by tertiary institutions for selecting students for admiss- 
ion, and by employers for distinguishing between job applicants. 
The point was often raised that the use of pupil evaluation for 
comparing and distinguishing between students was over emphasized. 

Rarely were pupils evaluated with the purpose of ascertaining 
the current status of their knowledge and underbtanding without 
comparison to other students. This information can provide valuable 
feedback for teachers in designing and modifying the teaching/ 
learning processes. Recent research has shown the critical import- 
ance of determining the nature of students 1 understandings of a 
given topic prior to instructions in that topic. 

Student Attitudes 

An important issue raised was the very negative attitudes 
that some students hold toward science education. Students consi- 
dered science to be too hard, requiring memorization of large 
amounts of information and being not relevant to their everyday 
lives. 

The emphasis on external examinations has had a significant 
influence in causing these poor student attitudes. Students focus 
only on the goal of passing the examination and their attitudes are 
reflected in statements such as "tell me only what I need to know 
and I will learn it", "if its not going to be examined I won't 
learn it", and "science is remembering, not doing". It was pointed 
out that teachers often promote these attitudes by using the threat 
of failing the examinations as a motivation factor. 



Chapter 2 



MAJOR ISSUES AND PROBLEMS 



Science education in participating countries has changed 
considerably in the past ten years. For many years science educa- 
tion was concerned primarily with facts and laws of science which 
vere memorized by students. Laboratory work, if done, was concerned 
mainly with verification of stated facts and laws. Science educa- 
tion was provided to a relatively small number of pupils. 

Science education today has different objectives and emphases. 
Pupils are expected to be active participants in the learning pro- 
cess, often doing activities and experiments with an inquiry approach, 
posing their own questions and seeking answers to them, discovering 
and solving problems, working vith everyday materials and scientific 
equipment, in classrooms, in the field and in equipped laboratories. 
Science education is one of the means to reduce prejudices and 
obscurantism. More countries are trying to provide science education 
to all pupils in the formal school system. 

The Concept of Evaluation 

Evaluation of pupil learning in science, which now is con- 
cerned with the new objectives and emphases, can be defined as 
"continual measurement of pupil achievements to assist in uecicion - 
making at various stages 11 . 

Both instructional and curriculum objectives should be evalu- 
ated, in the following categories: 

- cognitive : including both low and higher level objectives 
relating to the content of the curriculum; 

- affective : including interests, attitudes, values and 
cognitive preferences used in decisicn-making; 

- psychomotor : including manipulative and laboratory skills; 

- processes of science : which incorporate aspects of cogni- 
tive and psychomotor categories in particular. 
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Evaluation of pupil learning can be carried out in many ways 
including daily observations of pupils and their records, discuss- 
ions between teacher and pupils,, written tests, performance tests, 
teacher questioning, peer evaluation and pupil self-evaluation. 

Evaluation may have several purposes: 

(a) to meet a social need such as to provide a certificate 

on completion of a stage of schooling, to provide inform- 
ation to employers, or to indicate readiness for higher 
study ; 

(b) for grading or selection cf pupils. This purpose is often 
referred to as suaimative and usually takes place at the 
end of a unit of study or at end of term or end of a 

year of study; and 

(c) for provision of feedback to teachers for the diagnosis 
of learning difficulties of pupils. This purpose is 
referred to as formative and usually takes place part way 
through a unit or course. It requires follow-up to assist 
pupils who are having learning difficulties in order to 
improve instruction. 

The main purpose of pupil evaluation in science should be to 
improve instruction . While it is necessary to recognize the need 
of pupil ranking and selection, evaluation should be formative, to 
diagnose learning difficulties and follow up in order to improve 
instruction. 

Pre-requisites for Effective Evaluation 

In order to use pupil evaluation in this way, teachers must 
understand and value the importance of this purpose of pupil evalu- 
ation and they must have Knowledge and skills to carry out pupil 
evaluation and do the important follow-up. They must have valid 
and reliable instruments in order to evaluate effectively • 

Teachers must have time to plan, write and administer tests 
and to analyse and interpret the results and use them in order to 
improve instruction. 

Teachers must have the facilities (laboratories or science 
activity rooms, for example), equipment and resources for evaluation 
of manipulative and laboratory skills. 

They must be able to assist students individually to overcome 
learning dirficulties and improve their learning. 

6 
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Major issues and problems 

The curriculum materials (teachers guides, textbooks) must 
state the objectives of science teaching clearly, including higher 
level cognitive, affective, psychomotor and process objectives. 
These materials should contain science that is relevant to all 
students to assist them to live in and understand their environ- 
ment. There must be effective communication between teacher and 
pupils. 

Pupils should be interested in learning science and should 
work together co-operatively during learning activities. Provision 
should be made for pupils from disadva:* caged groups. 

Influences on Pupil Evaluation in Science 

The strongest influence on science education in the partici- 
pating countries is the status given to the external examinations 
and the pressure from parents and from society as a whole for pupils 
to obtain good results. The attitude of many governments, minis- 
tries, teachers, parents and communities is that the main purpose 
of pupil evaluation is to rank pupils for selection to higher levels 
of study. This attitude and concept of evaluation have led to 
domination of science teaching by external examinations, influencing 
both instructional and evaluation procedures. Society tends to be 
reluctant to accept changes in education, particularly changes in 
the purpose of pupil evaluation. 

The high status of external examinations is associated with 
examination bodies consisting largely of university and ministry 
staff with little involvement, if any, of competent teachers or 
parents. 

In general, teachers are not provided with sufficient experi- 
ence or training in using evaluation for improvement of instruct- 
ion. They often do not understand the new curriculum approaches 
and their skills to evaluate all curriculum objectives are not ade- 
quate for the task. 

Teachers are not provided with a sufficient range of exemplars 
of items and instruments for evaluation of higher level cognitive 
abilities, attitudes, processes and performance. They tend to 
evaluate achievement of lower cognitive objectives only and neglect 
higher cognitive, affective, psychomotor and process objectives. 

Because of problems experienced by teachers, many of which 
are due to factors beyond their control, pupils lose interest in 
school and many dislike learning science. Pupils from disadvantaged 
groups often do not receive special attention. Pupils often develop 
strongly competitive attitudes. 
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Constraints on Teachers 

There are many constraints on teachers which limit their 
ability to conduct pupil evaluation effectively. 

Teachers are often unable to complete the curriculum. They 
feel that they must do so in order to prepare pupils adequately for 
the demands imposed by external examinations. 

The level of resources available does not always enable pro- 
vision of laboratories and sufficient equipment. As a result, it 
is not always possible for teachers to evaluate pupils activity and 
laboratory skills. 

The language of science instruction in some cases is not the 
mother tongue of the students, resulting in difficulties of communi- 
cation between pupils and teachers. This creates problems in eva- 
luation which are aggravated when there is inadequate standardiza- 
tion of science terminology in some languages. Differences in lan- 
guage are associated with different cultural backgrounds of pupils 
who live in different geographical locations. Different fovms of 
evaluation instruments are often necessary to provide for these 
differences in pupils. 

Teaching loads are often very heavy and classes are large, 
making *t difficult for teachers to carry out evaluation and use the 
results in order to improve pupil learning. 

Most of the present day urriculum materials (teacher guides, 
textbooks) do not contain higher level cognitive, affective, psy- 
chomotor and process objectives that the teachers are expected to 
evaluate. 

The discrepancy between the needs of teachers for effective 
evaluation of science learning and the present situation in schools 
is due to societal (attitudes of society to evaluation) and econo- 
mic (financial) pressures. The pressures and constraints on science 
teachers have resulted in a number of major issues and problems 
concerned with pupil evaluation in science. 

The problems are identified and described in more detail in 
the following chapter. 
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Chapter 3 
DESIRABLE NEW DIRECTIONS 



The second task of the Meeting was to identify and work out 
some possible solutions to the problems and issues identified. 

In the following pages, besides stating each problem, there 
is a brief description of the premise which is the main, but not the 
only, factor in determining each problem. 

For most of the problems stated, there is a range of possible 
solutions given, and each country could implement or adapt those 
that are appropriate, according to its particular needs and avail- 
able resources. 



1 • Societal Factor 

Selection processes for jobs 
and for further study dominate 
the entire teaching/learning 
process. 



The Problem 

a) Examination results are 
used as the predominant or 
only factor for selection 
to further study, or to 
jobs. 



b) The external examination 
has an undue influence on 
the teaching/learning pro- 
cess. 

Possible Solutions 

While the external examinations remain, there is much scope 
for improvement of the examinations themselves: 

(a) the range of mental processes evaluated could be broad- 
ened using better constructed questions; 

(b) examination setters could be given help in working from 
a table of specifications of objectives and contents; 

(c) examination setters should have practical experience of 
the range of learning problems of pupils; and 

(d) teachers should be involved in examination setting pro- 
cess. Q 
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It is high time that there should be moves towards partial 
and then ultimately total internal assessment with responsibility 
given to schools to carry out the assessment of pupils' learning. 
Expert advice and moderation procedures, coupled with other proce- 
dures described below, should ensure that standards of teaching 
and learning will improve. The need for at least partial internal 
assessment is seen as highly desirable, for in this form of assess- 
ment the school can focus on objectives and techniques that cannot 
be adequately assessed by paper and pencil examinations, e.g.: 

- seminar presentations 

- discussion involvement 

- participation in debates on science-sc v issues e.g. 
conservation; creation-evolution 

- project work 

laboratory work, particularly manipulative skills 

Soir.a countries have external practical examinations which 
have an internally assessed component. For internal assessment 
pupils can be provided with practice in the skills to be assessed, 
and given the criteria of assessment. The pupils are given a novel 
problem to solve and report, or are asked to replicate a particular 
experiment already done. The mastery of manipulative skills used 
in the right context is critical, e.g. operation of a burette, 
pipette, etc., in volumetric analysis. 

It is noted that, while the possible solutions above require 
some moderation, the experience of several countries shows there 
are logistic problems with external practical examinations. 

A mark obtained in the school assessed section of the course 
can be portrayed separately or as part of the final mark incorpor- 
ating the examination mark. 

Any external examination results should be reported in con- 
junction with a student profile which could include information on: 

- aptitude in laboratory work 

- participation in school and class activities 

- responsibility, punctuality 

- communication skills - oral, written 

- decision making skills 

There should be an active programme to inform employers how 
to use such a profile in job selection. 

10 
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Once in place, there must be evaluation procedures to check 
the usefulness of such a profile. 

The groups that should be involved in the construction and 
monitoring of the student profile are teachers, employers, parents 
and regional administrative personnel. 



2. 



Teacher Factor 



The Problem 



The emphasis given to 
'evaluation 1 and to science 
education itself in many pre- 
service teacher training 
programmes is inadequate, 
e.g. 0-100 hours of science 
education in many primary 
teachers colleges. This re- 
duces the ability of teachers 
to understand and work con- 
fidently with the variety of 
evaluation procedures avail- 
able for use in the classroom. 
The opportunities for continual 
in-service training are 
limited. 



a) Inadequate understanding and 
perceptions of new goals of 
science education. 

b) Many teachers lack competence, 
confidence, positive attitu- 
des, and support to cope with 
the new emphasis on "doing" 
science and the processes of 
science. 

c) There is an emphasis on summa- 
tive evaluation of achievement/ 
performance rather than on 
formative evaluation to improve 
teaching and learning. 

d) In practice, teachers empha- 
size lower level cognitive 
objectives rather than higher 
level mental processes, in- 
cluding the systematic practice 
and development of process 
skills. 



Possible Solutions 

1. To provide pre and in-service training for teachers of science 
in: 
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(a) the value and use of diagnostic testing to improve 
teaching and learning; 

(b) the skills and processes used in construction and 

a ministration of tests and interpretation, especially 
for tests covering the full range of educational object- 
ives; 

(c) participating in development and analysis of a range of 
appropriate evaluation procedures, using expert advice, 
e.g. through such groups as Science Teacher Associations, 
school clusters, resource centres, etc.; and 

11 
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(d) remedial procedures for improving students' learning. 




2. Model teaching and learning packages can be developed and 
disseminated to teachers* These would show teachers how to 
use formative evaluation effectively in their teaching. Such 
packages could illustrate the range, strength and persistence 
of children's existing ideas before and during teaching in 
specific topics, and the mismatch between the students' 
achieved curriculum and the teachers' intended curriculum in 
a particular topics. 




3. School clusters could be set up to work on tasks of common 
interest and share information on pupil evaluation. These 
clusters should build on existing structures. 




4. Existing and new Resource Centres should be established to 
provide materials for pupil evaluation. 




5. Teachers could be encouraged to form Science Teacher 
Associations to provide assistance to teachers. 




Existing educational bodies, school groups, resource centres 
and teachers should work together to enable these solutions to be 
achieved . 




3. Instrumentation Factor Problem 




There are not sufficient appro- There is a lack of valid, re- 
priate evaluation instruments liable evaluation tests and 
available for teachers. other instruments (particularly 

in the affective and psycho- 
motor domains) . 




Possible Solutions 




There is much scope for the development of a large bank of 
pretrialled items and instruments within each country. Such a bank 
should include: 




(a) culture free or culture fair items covering the full 
range of education objectives; 




(b) a range of different types of item (multichoice, short 
answer, essay) and instruments with guidelines on how 
these can be used effectively in formative evaluation as 
well as in summative evaluation; and 




(c) detailed descriptions and specifications of all items. 
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These items should be made available to classroom teachers 
and information about them should be widely disseminated. 

Efforts should be made to identify item banks already in use, 
and to share these between countries. Expert item writers could be 
asked to contribute items. 

School clusters, regions, national centres and international 
centres should be involved in establishment of item banks. 



4 . Pupil Factor Problem 

There ir evidence that current a) Pupils lose interest, develop 
evaluation are having a negative competitive attitudes, and 
effect on students interest in may not take science subjects, 
and attitude to science educa- 
tion, b) Current evaluation procedures 



P ossible Solutions 

Evaluation procedures should be appropriate for the ability 
levels of different groups of students. 

Measures should be developed to ensure that the procedures 
do not disadvantage any group, e,g, pretrialling items. 

Evaluation procedures should account for alternative teaching 
strategies which are aimed at promoting student interest in science, 

- participation in science clubs , fairs and visits to places 
of interest in science 

- give co-operative exercises such as model making and use 
group evaluation 

- use criterion reference testing more often 

- relate teaching and learning to the pupils prior and 
everyday experiences 



Particular groups of students 
are being disadvantaged. 



disadvantage some groups, e,g, 
girls; ethnic minorities; 
those pupils with physical, 
mental or social disabilities. 
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5. Time Factor 

The demands on teacher 
preparation time and the 
nature of the overloaded 
curriculum do not allow for 
well prepared and conducted 
evaluation procedures. 



The Problem 

Teachers use time that could be 
given to formative evaluation for 
drilling for external examinations. 
Other teachers are unable to com- 
plete the stated curriculum 
effectively. 



Possible Solutions 

There should be on-going evaluation of the current curriculum 
concerning: 

(a) quantity of material in terms of content 

(b) resources available as opposed to those required to 
properly implement the curriculum 

(c) how teachers could be assisted to select curricular 
materials wisely 

(d) mismatch between achieved curriculum and intended 
curriculum 

Such an evaluation must involve cooperation among teachers, 
curriculum developers, and educational researchers. 



6. Local Factor 

In many countries in this 
part of the world, classrooms 
are often overcrowded. 
Teachers are unable to carry 
heavy workloads and give 
individual attention and 
assistance to students. 

Possible Solutions 



The Problem 

It is virtually impossible for 
teacher to cope with the diffi- 
culties faced by students in a 
large calss and to evaluate 
effectively ;he performance of 
these students. 



The effective use of oral evaluation, peer assessment and 
self-assessment could be looked into carefully to overcome the 
stated difficulty. Eventually, the class-size would have to b€ 
reduced to its optimum size. 

Teachers should have access to pre-prepared and tried evalu- 
ation items which can be used and interpreted with minimal effort. 
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7, Curriculum Objectives Factor 

One of the main concerns of 
current innovation in science 
education is to encourage 
student attainment of higher 
level cognitive, affective and 
psychomotor objectives. 

Possible Solution 



The Problem 

Existing science curricular 
materials (be it teacher guides 
or student texts) do not always 
adequately indicate higher 
level cognitive, affective and 
psychomotor objectives or how 
to evaluate them* 



Such objectives should be clearly stated for teachers to use. 
Also, where possible, relative emphases for cognitive, affective, 
psychomotor and process objectives at different levels of schooling 
should be made explicit to teachers. 

National Centres for curriculum should review their curriculum 
materials in view of ,theses requirements* ' 

Guidelines and exemplars on how these objectives can be 
evaluated should be provided. 



8, Facility and Resource Factor 

To teach science and hence to 
evaluate the learning outcomes 
meaningfully requires proper 
facilities, suitable equipment 
in sufficient quantity, and 
adequate resources. 



The Problem 

To a large extent, schools in 
many countries in this region 
are not well equipped with 
facilities and equipment. This 
poses great difficulty for 
teachers in their efforts to 
find an appropriate way to 
develop and evaluate the full 
range of science education 
objectives. 



Possible Solution 



One possible way is to establish or expard resource centres 
to provide the necessary equipment, hardware and software. Teacher 
should be encouraged to improvise and use readily available and 
low cost materials wherever possible. Ultimately, sufficient labo- 
ratories and adequate equipment should be provided. 
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Pupil evaluation in science 

The Problem 



In a good number of countries 
in this region, the mother 
tongue is often not the langu- 
age of science instruction. 
The problem is then one of 
determining what is actually 
being measured - science under- 
standing or language ability. 
This situation is more acute 
when equivalent examinations 
have to be set in different 
languages. Insufficient stand- 
ardization of science termino- 
logy increases the problem of 
communication. 

Possible Solution 

It is important that some kind of standardization of science 
terminology be made. This would certainly overcome the difficulty 
of using inappropriate terms for describing concepts in science. 
To improve student and teacher command of the language in which 
science is taught would equally be important. Where possible, 
having parallel forms of examinations in different languages could 
be an advantage. Cooperation between linguists, teachers and 
scientists is necessary to enable these tasks to be done. 

In translation of materials from one language to another, 
proper care should be taken in order to maintain uniformity among 
various language versions of test items. 



9 . Language Factor 

Good communication between 
teacher and pupils (students) 
is always essential for effect- 
ive evaluation. Good command 
of the language of instruction 
by teacher and pupils is a 
strong asset. 
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Chapter A 



SOME STRATEGIES AND METHODOLOGIES 
FOR EVALUATING PUTIL ACTIVITIES 



Despite the efforts made by the participating countries to 
improve their science education programmes, there are still problems 
in the area of pupil evaluation. Some of these problems can be 
resolved in the short term, others require longer term solutions. 
There is an urgent need for immediate action to be taken. 

With the stress on processes and methods of science and the 
need to evaluate higher cognitive, affective and psychomotor object- 
ives, science teachers have a very difficult but vital and signi- 
ficant rcle. The success of science education and pupil evaluation 
in science is dependent upon the ability of teachers to carry out 
their central role effectively. 

Teachers have heavy demands on their time and abilities and 
many are under pressure to change their approach to concentrate on 
fundamental science skills and processes. There is an increasing 
need to develop their abilities and to provide them with the oppor- 
tunity to use strategies and methodologies that will assist them 
to improve pupil evaluation. 

The following strategies and methodologies relate to pupil 
performance evaluation, an area of pupil evaluation that has been 
relatively neglected because there are many difficulties, in carry- 
ing out such evaluation effectively in the present situation. 

The concept of performance evaluation used here relates to 
understanding what is actually occurring when students are 'doing 1 
science, and how both the process of science as well as the products 
of such experiences of students can be evaluated. Thus pupil per- 
formance evaluation is not restricted to measuring whether or not 
pupils can carry out or perform specific actions, such as to 
measure length wirhin given specifications but includes knowledge 
and attitudes used to find the answers to problems posed. 
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Pupil evaluation in science 

Strategies 

Training in task analysis 

Science teachers often do rot understand that pupil activities 
and laboratory tasks require pupils to use knowledge and attitudes 
in addition to manipulative and laboratory skills. Since their 
understanding is essential for good teaching and pupil evaluation, 
steps should be taken to help them to see the different processes 
and skills involved in pupil activities. 

Teachers can be trained to analyse each activity or laboratory 
task into its components. When they realize the whole spectrum of 
what a pupil evaluation activity will covpr, evaluation will no 
longer be such a difficult task. 

An illustration of a task analysis is provided in Table 1 
on the following page. 

Pupil peer evalua. ion and self-evaluation 

With large class sizes it is impossible for teachers to eva- 
luate pupils actions individually. However, pupils can be trained 
to work in groups using a combination of peer evaluation and self- 
evaluation to evaluate their own activities, and the activity itself. 

Training can include use of a set of guide questions for 
pupils to use. Pupils can discuss the contributions of each group 
member and should be encouraged to think carefully about what Lney 
are doing and why they are doing it. 

An example of a guide for pupil evaluation is provided in 
Table 2 on page 20. 
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TABLE 1 



Example of a task analysi s 
Task : Identify a sample block of metal (copper) 




Pupil evaluation in science 



TABLE 2 

A checklist of questions suitable for science 
activity evaluation and self evaluation 



1. What were you trying to find out or show? 

2. Were the instructions easy to follow? 

3. What words did you find hard? 

4. Did you know exactly what to do? 

5. Was anything hard to do or understand? 

6. If you asked for help, who did you ask? 

7. Why that person? 

8. When you did each part of the activity, did you 
really know what you were doing? 

9. If you talked to other students about the activity, 
which did you talk about? 

10. Wha** were the results you got from the activity? 
What did your results mean to you? 

11. When you got a result, did you think it was what 
the teacher expected you to find out? 

12. What did you do with your results? 

13. What have the results to do with what you were 
trying to find out, show, or prove? 

14. Did you really understand what you were doing 
during the activity? 

15. Is everyone getting an opportunity helping to 
get the work done? 

16. Is everyone willing to work? 

17. Did you enjoy the work? Why? 
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Use of worksheets 

Worksheets are a useful alternative to observation of pupil 
actions. They may be structured, unstructured or a combination of 
both types. Examples of these different types of worksheets are 
given in Table 3. 

A structured worksheet provides directions for pupils to 
follow and questions that evaluate their progress through an activity. 

An unstructured worksheet may pose a problem in the form of 
an open-ended question, leaving pupils to work out their own proce- 
dures. A guide to the type of report required may not be present 
or may be in general form: for example, asking pupils to record 
what they did, why they did it, what they saw (heard, or smelled) 
and what they concluded. 



A . Structured 

1. Look at the sample. What colour is it? 

2. How many petals do you see? 

3. What is the length of the biggest petal? 

B. Unstructured 

Outline the procedure you would use to identify the unknown 
substance A. 

Carry out these procedures and record all observations. 

C. Combination of structured and unstructured 

Problem: Of the three miniature light bulbs on the desk 
(A, B, C) only one is a flashing light. 

1. After investigating, write in the space below which is 



2. How can the three bulbs be wired up so that two of them 
flash and one emits a steady light? 



TABLE 3 



Examples of Worksheets 



the flashing bulb. 



Answer: 
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When you have carried out the experiment, first complete 
diagram 1. Next, using th*. symbols below, show how the 
bulbs should be wired up (diagram 2) . 



i — 



Symbols 




Diagram 1 



battery light bulb 




Diagram 2 



A Guide to Expectations of Pupil Ability at Different Levels 

Teachers have difficulty in understanding at what year or 
grade level different processes are appropriate. Some processes 
can be evaluated at all levels but at different degrees. For exam- 
ple, primary pupils may measure length with handspans or with a 
ruler using large units, while senior secondary pupils would be 
expected to use vernier scales to a high degree of accuracy. 

Other processes may not be appropriate for junior pupils. 

Teachers need detailed guidance on which processes are appro- 
priate for which levels and to what degree. 

Guide to Frequency of Evaluation of Each Process 

Teachers could be assisted by an indication of the relative 
importance of each process at each age or year level and a guide 
to the desirable frequency of evaluation of each process. In this 
guide, frequency of evaluation needs to be stated for each method 
of evaluation, such as observation of pupil actions by the teacher, 
pupil group self-evaluation, use of worksheets, and teacher quest- 
ioning. 

The guide should provide flexibility for teacher use and 
should indicate possible frequencies for different objectives and 
different groups of pupils. p~ 
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Methodologies of pupil performance evaluation 
Observation of pupils doing science 

One way to evaluate effectiveness of teaching is to observe 
the behaviour of pupils and to record the observations. Observations 
can direct whether or not students are interested in or are enjoying 
the task and how well they use the materials and equipment provided. 

Observations can be carried out by pupils or teachers. 
Checklists may be used to provide a structure for the observations. 

An example of a checklist for teacher observation of pupil 
activity is provided in the Table 4. 



TABLE 4: Example of checklist to help 

teacher observations of pupils 





o 


PQ 


*-« 


d 


ley K. 


53 

c 


Ley B. 




Keitt 


John 


Aaroi 


Joani 


Shel] 


Marie 


Shel] 


A. OBSERVING 
















Will spend time observing items 
which interest him/her. 


✓ 


y 


V 


y 


/ 


/ 


y 


Make use of the different 
senses to observe accurately. 




✓ 


y 




y 


y 




Can focus on a specific item in 
a mass of information . 




✓ 




s/ 


y 






Notice changes in the 
environment. 


✓ 


y 




y 


y 




J 
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Questioning 

Questioning of pupils during the progress or at the end of an 
activity can provide information on pupil attitudes, knowledge and 
difficulties experienced in the use of equipment. 

Such questions can be asked by the teacher or can be part of 
the pupil group self-evaluation. They can be unstructured, such as 
"How are you doing?", or very specific, such as "What did you see 
when you did that?". They can be incorporated into a vorksheet or 
checklist or left open to teacher or pupil initiative. 

Analysis of pupils reports 

Pupils can be asked to report orally or in written form, 
individually or as a group. Oral reports are useful to evaluate 
pupils ability to explain orally and to use appropriate language 
and terminology. Written reports can achieve the same purposes 
Lut, in addition, can be used to evaluate ability to present inform- 
ation in an organized fashion, to make drawings, to draw graphs, 
and in general, to present in visual form. 

Worksheets can be used to structure reports. 
Test sheets 

Evaluation questions can be used in conjunction with instruct- 
ions on how to carry out an activity or on separate sheets from the 
instructions . 

Test sheets can be structured in such a way that pupils will 
succeed only after carrying out a certain activity in the right 
way. For example, pupil can be asked to identify an object and 
must use a hand lens successfully in order to do so. Alternatively, 
pupils can be asked to bore a hole in a cork and can only do so if 
they can use or cork borer. Example of a test sheet is presented 
in Table 3 (item C) . 

Pencil and paper tests 

Construction of good pencil and paper test items to evaluate 
pupil performance is difficult and time consuming. Such items need 
to be combined with other methods of evaluation to cover all per- 
formance objectives. 

Some sample pencil and p^per test items are shown in Tables, 
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TABLE 5: Examples of different types 
of Multichoice Items 



1. is Cognitive: Recall/Comprehension 

2. is Performance: Measurement 

3. is Process: Control of Variables 

4. is Affective/Cognitive: Withholding judgement. 

A. Which of the following particles are gained, lost or shared 
during chemical changes? 

a) electrons furthest from the nucleus of the atom 

b) electrons closest to the nucleus of the atom 

c) electrons from the nucleus of the atom 

d) protons from the nucleus of the atom 

e) neutrons from the nucleus of the atom 

B. How long is the block of wood shown in the diagram? 




10 20 30 

length in cm (centimetres) 



a) 10 cm 

b) 20 cm 

c) 25 cm 

d) 30 cm 

e) 35 cm 

C. Mary and Jane each bought the same kind of rubber ball, Mary 
said "My ball bounces better than yours." Jane replied, 
"I'd like to see you prove that/ 1 What should Mary do? 

a) Drop both balls from the same height and notice which 
bounces higher. 
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b) Throw both balls against a wall and see how far each ball 
bounces off the wall. 

c) Drop the two balls from different heights and notice which 
bounces higher. 

d) Throw the balls down against the floor and see how high 
they bounce. 

e) Feel the balls by hand to find which is the harder. 

D. Which statement is true about an organism seen on a plant? 

a) It is a parasite 

b) It has sucking mouth parts 

c) It is impossible to tell 

d) It feeds on plants 

Home involvement 

Traditionally, the resources available at the homes of pupils 
have not been used effectively by teachers. Considering the fact 
that home background of pupils is a large factor influencing pupil 
achievement at school, home involvement in the evaluation of 
science processes and skills can be very beneficial. 

In the Science-For-All context, the home can provide enrich- 
ment for the science learning and evaluation task. 

Parents can be assisted to work with their children to eva- 
luate progress in science learning. They can be assisted by work- 
sheets or checklists on which feedback can be provided to pupils or 
to the teacher. Pupils can train their parents to wcrk with them 
in a group self-evaluation activity. Parents can observe pupils 
activities, ask them questions and discuss what the pupil is doing 
and thinking. Questionnaires and opinionnaires can also be used. 

Model making 

Models can vary from simple constructions to complex working 
models. The degree of detail in construction, accuracy of repre- 
sentation or results and time taken to construct can vary consider- 
ably. Care must be taken to specify the purpose of the model and 
to limit the task to what pupils can reasonably achieve. 

Model making can evaluate the highest forms of creativity in 
pupils. Models can be constructed from knowledge gained by read- 
ing, by experience, and imagination and creativity can be expressed, 
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Science fairs can be used to motivate students and stimulate 
their creativity. 

The strategies for assisting teachers and methodologies of 
pupil performance evaluation outlined above can be used effectively 
to improve pupil evaluation by teachers. 

Research projects 

In order to provide additional support to teachers, two re- 
search projects are proposed, 

1, Empirical investigations of pupils concepts of scientific 
phenomena : Such investigations should be conducted at 

two levels - at a research level, in research institutions, 
and at an action-research level, in the form of action- 
research by teachers in classrooms, 

2 , Development of a standard list of science processes 
related to doing science : At present there is lack of 
uniformity between countries on the specification and 
application of science process. Reference to a standard 
list would facilitate communication between countries. 

Other follow-up activities that could be undertaken to improve 
pupil evaluation in science are outlined in the previous chapters. 
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